PointINet: Point Cloud Frame Interpolation Network

نویسندگان

چکیده

LiDAR point cloud streams are usually sparse in time dimension, which is limited by hardware performance. Generally, the frame rates of mechanical sensors 10 to 20 Hz, much lower than other commonly used like cameras. To overcome temporal limitations sensors, a novel task named Point Cloud Frame Interpolation studied this paper. Given two consecutive frames, aims generate intermediate frame(s) between them. achieve that, we propose framework, namely Network (PointINet). Based on proposed method, low rate can be upsampled higher rates. We start estimating bi-directional 3D scene flow clouds and then warp them given step based flow. fuse warped frames cloud(s), learning-based points fusion module, simultaneously takes into consideration. design both quantitative qualitative experiments evaluate performance interpolation method extensive large scale outdoor datasets demonstrate effectiveness PointINet. Our code available at https://github.com/ispc-lab/PointINet.git.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Interpolation Search for Point Cloud Intersection

We present a novel algorithm to compute intersections of two point clouds. It can be used to detect collisions between implicit surfaces defined by two point sets, or to construct their intersection curves. Our approach utilizes a proximity graph that allows for quick interpolation search of a common zero of the two implicit functions. First, pairs of points from one point set are constructed, ...

متن کامل

A Temporally-Aware Interpolation Network for Video Frame Inpainting

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame interpolation and video prediction because we have access to both the temporal context and a partial glimpse of the future, allowing us to better evaluate the q...

متن کامل

Deep Frame Interpolation

This work presents a supervised learning based approach to the computer vision problem of frame interpolation. The presented technique could also be used in the cartoon animations since drawing each individual frame consumes a noticeable amount of time. The most existing solutions to this problem use unsupervised methods and focus only on real life videos with already high frame rate. However, ...

متن کامل

PU-Net: Point Cloud Upsampling Network

Learning and analyzing 3D point clouds with deep networks is challenging due to the sparseness and irregularity of the data. In this paper, we present a data-driven point cloud upsampling technique. The key idea is to learn multilevel features per point and expand the point set via a multibranch convolution unit implicitly in feature space. The expanded feature is then split to a multitude of f...

متن کامل

PhaseNet for Video Frame Interpolation

Most approaches for video frame interpolation require accurate dense correspondences to synthesize an inbetween frame. Therefore, they do not perform well in challenging scenarios with e.g. lighting changes or motion blur. Recent deep learning approaches that rely on kernels to represent motion can only alleviate these problems to some extent. In those cases, methods that use a per-pixel phaseb...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2021

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v35i3.16324